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Temporal autocorrelation functions for avalanches in the Bak-Sneppen model display aging be- 
havior similar to glassy systems. Numerical simulations show that they decay as power laws 
with two distinct regimes separated by a time scale which is the waiting time, or age, of 
the avalanche. Thus, time-translational invariance is dynamically broken. The critical expo- 
nent of the initial decay is that of the familiar stationary dynamics while a new critical ex- 
ponent for the late-time behavior appears. This new exponent characterizes a non-stationary 
regime that has not been previously considered in the context of self-organized criticality. 
PACS numbers: 64.60.Lx, 05.40.-hj, 05.70.Ln 



Self-organized criticality (SOC) describes a general 
property of slowly-driven dissipative systems with many 
degrees of freedom to reach a stationary state where 
they evolve intermittently in terms of bursts spanning 
all scales up to the system size. Many natural avalanche- 
like phenomena have been represented using this idea, 
including earthquakes extinction events in biological evo- 
lution, and landscape formation B. Recently, SOC has 
been observed in controlled laboratory experiments on 
rice piles . Theoretical models of rice piles B are re- 
lated to a variety of different physical systems by uni- 
versality |5| . The emergence of long-term memory in the 
self-organized critical state has been demonstrated ana- 
lytically for a multi-trait evolution model [|6|, a variant 
of the Bak-Sneppen model [Q. 

Here we show that the self-organized critical state in 
the Bak-Sneppen model exhibits aging behavior that is 
reminiscent of glassy systems |8| . We numerically mea- 
sure two-time autocorrelation functions for avalanches 
and observe a power-law decay with two distinct regimes. 
The early time power law regime is that of the familiar 
stationary dynamics. The late time regime has a new 
critical exponent characterizing the history-dependent 
relaxation behavior of the model. The time scale sep- 
arating the early and late time regimes is the age of 
the avalanche. Rescaling the autocorrelations measured 
in units of the respective age collapses the data onto a 
scaling function of a single variable. The distinct late 
time regime signals a breaking of time-translational in- 
variance arising from the system's ability to store infor- 
mation from past events over arbitrarily long times. 

"Aging" is an important phenomenon observed exper- 
imentally in glassy materials where relaxation behavior 
depends on the previous history of the system H] . For 
instance, consider a spin glass quenched below the glass 
transition at time t — Q in the presence of a small mag- 
netic field. Throughout the sample, domains of various 
pure states develop that grow with characteristic size 



R{t). At time t — t^, the magnetic field is turned off 
and the system's response in the form of its remanent 
magnetization is measured. Initially, the response func- 
tion is only sensitive to the pure, quasi-equilibrium states 
in their distinct domains. But after an additional time 
scale related to the waiting time, t^ , the response spans 
entire domains and slows down when it experiences the 
non-equilibrium state the sample possesses as a whole. 
A simple scaling form holds for some glassy systems [O . 
The autocorrelation function for the remanent magneti- 
zation is given by 
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where /(x ^ 0) -^ constant and f{x » 1) ~ x"*" with 
r > 0. Similar aging behavior also appears in a variety 
of other problems such as coarsening dynamics, directed 
polymers in random media, etc. [ |ll[ . 

Generally, this type of correlation function can be 
measured for avalanches in the self-organized critical 
state (which will be specified below for the Bak-Sneppen 
model). Here, we define the waiting time, t„, to be the 
time since the beginning of the avalanche. In order to 
eliminate trivial effects of norm conservation |12|] refer- 
ring to the fact that avalanches die, we only consider 
the dynamics of infinite avalanches, or those that survive 
longer than any time scale we consider. We focus on a 
simple quantity, Pf^^:st{t)^ measuring the first returns of 
the activity to a given site. A power law distribution for 
^first(^) has been measured numerically for a variety of 
different SOC models [0| by recording first returns to 
every site visited during the avalanche. Here we measure 
the probability Pfirst {tw ; i) for the infinite avalanche to 
return after t time steps to a site that was visited most 
recently at time t^ from the beginning of the avalanche. 
Thus, to determine the first-return probability, we take 
the age of the avalanche, t^, into account. While in the 
stationary state of SOC models the first return distribu- 
tion is generally Pf^^s^_[t) ~ f~^""*, {t -^ cx)), we find for 



the Bak-Sneppen model 
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The exponent Tfirst can be related to other critical expo- 
nents via scaling relations for SOC [Q. The origin of 
the coefficient r is non-trivial, signaling the dynamical 
breaking of time-translational invariance in the infinite 
avalanche. (For instance, the first-return probability to 
any site n for a random walker that started at the origin 
at time t' — and passed site n at time t^ is clearly 
independent of t^ unless time translational invariance 
is explicitly broken.) In glassy systems, the coefficient 
r usually refers to off-equilibrium properties of the sys- 
tem [H . The question then arises whether the coefficient 
r in Eq. (0) can be related to the known universal co- 
efficients of the stationary SOC process, or whether it 
describes new physics in the avalanche dynamics of the 
Bak-Sneppen model, and possibly other models of SOC. 
The Bak-Sneppen model |Q has been studied intensely 
and with great numerical accuracy in recent years. We 
refer to Ref. |I3| for a review of its many features and 
simply utilize those facts here. The model consists of 
random numbers Xi between and 1, each occupying a 
site i on a lattice in, say, d = 1. At each update step, 
the smallest random number Xmin{t) is located. That 
site as well as its two nearest neighbors each get new 
random numbers drawn independently from a flat distri- 
bution between zero and one. The system evolves to a 
SOC state where almost all numbers have values above 
Ac, with Ac avalanches formed by the remaining numbers 
below. In our simulations, we have used the equivalent 
branching process [Q with Ac = 0.66702 to eliminate any 
finite-size effects. Initially, at time ta = 0, the smallest 
threshold value is set equal to Ac to start a Ac avalanche. 
In every update ta -^ ta + I, only the signal Aniin(^a) 
and its two nearest neighbors receive new threshold val- 
ues. At any time, we store only those threshold values 
Ai < Ac that are part of the avalanche because only those 
numbers can contribute to the signal, i. e. can ever be- 
come smallest number. In addition, we keep a dynamic 
list of every site that has ever held the signal at some 
time to determine the first-return probabilities. It has 
been shown that the Bak-Sneppen model in d = 1,2 is 
a fractal renewal process p3| , i. e. activity is recurrent 
for each site unless the avalanche dies. Avalanches end 
when there are no Xi < Ac, and a new (independent) 
avalanche is initiated with ta = 0. If the avalanche sur- 
vived longer than tco = 2^^ then we store the data for 
the first returns; otherwise the data is discarded. This 
way, we probe properties of infinite avalanches up to the 
cut-off time scale t co- 
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FIG. 1. Log-log plot of the first-return probabilities 
-Pflrst(im;i) as a function of t for various tm in the one di- 
mensional Bak-Sneppen model. The graphs are consecutively 
labeled from bottom to top by z = 1, 2, . . . , 9 where each 



graph contains data for all 8' 



< i„ < 8' - 1. To avoid 



overlaps, each distribution is offset by a factor of 2*. Initially, 
each graph falls like a power law with the familiar coefficient 
Tflrst = 1.58. But for values of t 3> t^, each graph crosses 
over into a new power law regime with a larger coefficient. 
For reference, we have also plotted the first return distribu- 
tion for the combined data as a dashed line on the right. Note 
the smooth power law behavior over six decades until cut-off 
effects set in at about lO'^ « 0.1 tco- 

At each update ta we determine the previous time tw 
when the signal was on the same site most recently (if 
ever). Then its first-return time is give hy t = ta — tw, 
and we bin histograms labeled by i = [i log2 tu,] and 
j = [log2 f] . The data is binned logarithmically so that 
in each bin a comparable number of data points is aver- 
aged over: for each increment of j, the width of the bins 
for t increases by a factor of 2, while for each increment 
of i the tw bins increase by a factor of 8. Pfirst{tw',t) 
for various values of t^, and Pfirst(i) obtained from the 
combined data, are plotted in Fig. |l|. Each graph refers 
to a different range for i„, increasing by a factor of 8 
each time from left to right. Each graph possesses two 
distinct power law regimes, separated by a crossover. To 
determine the form of the scaling function f{x) for these 
graphs according to Eqs. (g), we note that the crossover 
appears to scale linearly with t^;. Thus, we plot 

/(.T)-r«"'Pfirst(i^;0 with x^^ (3) 

using Tfirst = 1.58 |]l3|, see Fig. ||. The data collapses rea- 
sonably well onto a single curve, f{x), which is constant 
for small argument, and appears to fall like a power law 
with coefficient r = 0.45 ± 0.10 over two decades. The 



numerical value for r is difficult to extract with greater 
accuracy because it refers to properties deep within the 
tail of the distribution, but it is sufficiently accurate to 
prove the existence of a distinctly new regime at time 
scales beyond t^, indicating aging behavior. The data 
excludes the possibility that the effect is due to some hid- 
den cut-off (an exponential would have to be extremely 
weak to fall for less than a decade over two decades in its 
argument), or due to mere statistical noise. Similar re- 
sults were obtained for the two dimensional Bak-Sneppen 
model where we find r = 0.25 ± 0.10. Although a smaller 
value of Tfiist — 1-28 in the two dimensional Bak-Sneppen 
model leads to many more events in the tail of the auto- 
correlation functions, our numerical results in that case 
are less conclusive due to apparent significant corrections 
to scaling in the distribution for the first returns ||l7||. 
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FIG. 2. Data collapse according to Eq. (|^ for the data 
in Fig. |l| (using the same symbols), discarding data for i = 1 
and i = 9 to eliminate short-time and cut-off effects, respec- 
tively. The scaling function f{x) is constant for small argu- 
ment and appears to follow a power law for a; ^ 1 for about 
two decades before the data gets too noisy. The two dashed 
lines that bracket the power law tail correspond to x~ 



and 



We estimate r = 0.45 ± 0.10. 



As written, the scaling theory of Ref. [n3J does not de- 
scribe the origin of the coefficient r since it considers only 
stationary properties of avalanches where the breaking of 
time translational invariance does not appear. We have 
considered domain growth approaches to explain the ori- 
gin of aging, without success. For instance, the activity 
in an evolving avalanche spreads over a domain that is 
growing with a characteristic length scale R{t) ^ t^/^ 
p3[. Thus, between t^ and t^ -f i, the domain covered 
by the avalanche has grown and might have decreased 
the probability to return to a particular site by a fraction 



(1 + tlt^y^l^, implying r = djD. For d = 1, D w 2.43 
]l3| , which agrees well with the result for r, but for d = 2, 
D ss 2.92, which is inconsistent with the above result for 
r. However only few sites inside an avalanche domain 
are actually part of the avalanche at any one time, their 
number merely growing like f^' with dg ~ 0.11 and 0.25 
in d = 1 and 2 |13| . Assuming that r = d^ is inconsistent 
with the measured value of r for d = 1. While similar ge- 
ometrical arguments may quantitatively explain observed 
aging behavior in systems whose dynamics is dominated 
by the coarsening of domains |jlq| , it appears that aging 
in the Bak-Sneppen model and possibly other SOC mod- 
els is more intricately linked to the long term memory 
of the process which can distinguish sites that were last 
visited early in the avalanche from those visited much 
later. 

We have also investigated the possibility of aging in 
other SOC models such as the Abelian sandpile due to 
Bak, Tang, and Wiesenfeld (BTW) and the Manna 
two-state sandpile model fig] , which will be reported in 
detail elsewhere |17] ]. In short, numerical measurements 
of the first return probabilities for the Manna model show 
no sign of any age dependence at all. The BTW model 
M does show nontrivial aging behavior which is quite dif- 
ferent from that of the Bak-Sneppen model, i.e. neither 
its scaling variable nor its scaling function is as simple 
as Eq. (0) . The appearance of aging in the BTW model 
demonstrates at least a weak memory not included in 
the discussion of Ref. jl^ . Despite the gross similarities 
between the BTW and the Manna model, our results sug- 
gest that the avalanche dynamics in both models is com- 
pletely different; in fact they have been found to belong to 
different universality classes [Esj . We do not know yet to 
what extent aging is a general property of self-organized 
critical systems. 

It is well known from the study of amorphous mate- 
rials that systems with hierarchically ordered dynamics, 
where slow degrees of freedom can only advance after 
faster ones have moved collectively, typically lead to slow 
relaxation behavior |2C| ], similar to the power-law dis- 
tributed avalanches in SOC. For instance, frustration has 
been identified as a cause for slow relaxation in spin sys- 
tems, requiring cooperative behavior between ever more 
distant spins to further decrease their collective energy. 
Phenomenological models of relaxation in glassy systems 
pi| attribute slow relaxation and aging to the compli- 
cated phase-space structure, with a highly degenerate 
equilibrium state, and with a hierarchy of ever-higher 
barriers slowing the approach to any state of lower en- 
ergy, that originates from the inherent randomness in the 
microscopic interactions. Previously, explicitly hierarchi- 
cal models of diffusion on ultramctric trees have been in- 
voked to describe experimental findings for such glassy 
systems p2| , including their aging behavior [E3[ . 

Remarkably, the Bak-Sneppen mechanism shares 
many of these "glassy" features. The far-from- 



equilibrium dynamics is characterized by a large pool of 
virtually inert ("frozen") threshold values, equally dis- 
tributed above Ac, assuming one among an infinite de- 
generacy of quasi-stable configurations that the process 
is attracted to. The update process perturbs the sys- 
tem, inducing avalanches which are relaxations events to- 
wards a new such configuration. In avalanche dynamics, 
active ( "fast" ) threshold values achieve improved stabil- 
ity only through the cooperative behavior of neighboring 
sites. A critical avalanche can only end through a long- 
range cooperation of many sites. These avalanches, as 
in all extremal models of SOC, consist of a hierarchy of 
sub-avalanches which are temporally and spatially con- 
tained within their parent avalanches ||l^. In Ref. ||] 
we showed how this hierarchical structure in the analyti- 
cally tractable multi-trait model leads to the build-up of 
memory during an avalanche. There, we also explored 
the ultrametric properties of the self-organized critical 
state, and found that the ultrametric separation between 
consecutive minima evolves to be power-law distributed. 
Thus, while imposed explicitly to describe aging in glassy 
systems in Refs. 123] , hierarchical or ultrametric struc- 
tures emerge dynamically in some models of SOC and 
apparently lead to similar aging behavior. 

Our numerical results demonstrate that aging occurs 
not only in glasses and other out of equilibrium systems 
slowly approaching their asymptotic equilibrium state, 
but also occurs in some models of self-organized critical- 
ity. Aside from glasses or SOC, there exists a much wider 
range of important problems exhibiting certain aspects of 
glassy behavior, for example the directed polymer [11|, 
protein folding, learning, or optimization algorithms [ 24 1 . 
The dynamics of these problems is poorly understood and 
often conceptualized in terms of a walk through a "rugged 
landscape" |2^. More than adding another problem to 
that list, we believe that the avalanche dynamics of some 
SOC models is far more accessible, with many subtle fea- 
tures considering their simplicity, that they might pro- 
vide a basic framework to study the emergence of slow 
relaxation and aging. This is certainly possible if the 
mechanism responsible for aging is avalanche dynamics 
in systems approaching a critical state. 
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